Multimodal Queries to Access Multimedia Information Sources: First Steps
نویسندگان
چکیده
This position paper deals with queries beyond text, mixing several multimedia contents: audio, video, image and text. Search approaches combining some of these formats have been studied, including query by example techniques in situations where only one format is considered. It is worth mentioning that most of these research works do not deal with text content. A new approach to allow users introducing multimodal queries and exploring multimedia repositories is proposed. For this purpose, different ranked result lists must be combined to produce the final results shown for a given query. The main goal of this proposal is to reduce the semantic gap between low level features and high level concepts in multimedia contents. The use of qualitative data giving more relevance to text content along with machine learning methods to combine results of monomodal retrieval systems is proposed. Although it is too soon to show experimentation results, a prototype implementing the approach is under development and evaluation.
منابع مشابه
Visual Information Retrieval through Interactive Multimedia Queries Former Title: Intelligent Multimodal Interfaces for Visual Information Retrieval PhD Second Year Report
متن کامل
شناسایی و دستهبندی مهارتهای مورد نیاز دانشجوی مجازی
The purpose of this survey is provision of a conceptual model for identification andcategorization of skills required for virtual student. Special environment of virtuallearning has posed inevitable necessities which should be considered: skills requiredfor virtual student is identified and categorized. Two main questions of the researchinclude: 1- What properties does have virtual learning env...
متن کاملCreating Personalized Video Presentations using Multimodal Processing
At a minimum, a multimedia database must contain the media itself, plus some level of metadata which describes the media. In early systems, this metadata was limited to simple fields containing basic attributes such as the media title, author, etc. and the user would select media using relational queries on the fields. Video on demand systems are one example of this. More recently, systems have...
متن کاملMuST: Workshop on MUltimodal Summarization for Trend Information
The MuST (Multimodal Summarization for Trend Information) workshop was designed to encourage cooperative and competitive studies on summarization and visualization for trend information. The main objective of the workshop is to develop technologies using multimedia presentation that will allow intelligent systems to provide users with appropriate answers to their queries on trend information. T...
متن کاملA Method for Protecting Access Pattern in Outsourced Data
Protecting the information access pattern, which means preventing the disclosure of data and structural details of databases, is very important in working with data, especially in the cases of outsourced databases and databases with Internet access. The protection of the information access pattern indicates that mere data confidentiality is not sufficient and the privacy of queries and accesses...
متن کامل